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The intent of this admittedly small scale and unsophisticated trial was to test the 
response of General Practitioners to being given a form to fill out following a 
television broadcast, to test the value of the semantic differential method for testing 
subjective responses to the programs, and to see if some means of testing by 
multiple-choice questions could be used to assess knowledge gain immediately 
following the broadcast. Three programs of the BBC 2 production "Medicine Today* 
were selected as the subject matter for these tests. Clinical tutors and other 
organizers in ten areas were sent 270 forms on each of the three months to 
distribute to groups of doctors who met in hospitals and elsewhere to watch the 
lunchtime transmission of the programs. Replies from the General Practitioners 
numbered 104, 95, and 107 respectively for each of the three programs. The 
semantic differential provided the most valuable assessment of subjective responses 
so far obtained for these programs and was easily understood by the doctors. 
Multiple-choice questions following the second program proved to be confusing and 
were replaced by factual questions for the third program. A section including copies 
of the questionnaires and compilation of the responses is appended. (RP) 
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OFFICE OF EDUCATION 



THIS DOCUMENT HAS BEEN REPRODUCED EXACTLY AS RECEIVED FROM THE 
PERSON OR ORGANIZATION ORIGINATING IT. POINTS OF VIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRESENT OFFICIAL OFFICE OF EDUCATION 
POSITION OR POLICY. 



MEDICINE TODAY. 



A small scale trial of subjective responses 
of doctors viewing television in groups. 



"by R.Ll.Ueyrick. 




Television Section 

Association for the Study of Medical Education. 



> M1SDLC1XL' TODAY* - A SMALL SCALD TltlAL 



INTO SUBJECTIVE ItESPONSfi OF DOCTORS 



The purpose of this small-scale and unsophisticated 
trial was to test three major matters. 

Firstly, the response of General Practitioners and 
other doctors to being given a form to fill in following 
a Television broadcast. 

Secondly to test the value of a semantic differential 
method for testing subjective responses to the Television 
programmes. 

Third! v, to see if some means of testing by mulitple 
choice questions could be used to assess knowledge gain 
immediately following the broadcast. 



It was known that a number of groups of doctors meet 
in hospitals and elsewhere to view the lunchtime transmission 
on BBC 2 of the Medicine Today programmes. It was also known 
that the BBC proposed to broadcast three programmes, linked 
in nature, concerning the diagnosis, management and treatment 
of wheezing in young children. It was therefore decided to 
send, without warning, a number of forms to Clinical Tutors 
and other organisers in ten areas where groups were known 
to meet, asking them for their co-operation and comments 
with regard to testing the three programmes under discussion. 



We should record, with appreciation the co-operation 
offered and the response received from the Clinical Tutors 
and others involved. 



In the event, 270 forms were sent on each of the three 
months, but due in some cases to technical failures of 
reception and in others to local difficulties, the same 
groups did not respond on all three occasions. As the 
programmes are originally designed and transmitted for 
viewing by General Practitioners, the response of Hospital 
Staff and Public Health Staff, although included in the 
returns, are not analysed on the graphs or in the response 
to multiple questions. 



The first programme — 104 replies were obtained from 
General Practitioners and 38 from Hospital Staff, making 
a total of 142. 4 forms were not included as the information 

carried on them was inadequate for analysis. 
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i'lie second programme - 95 General Practitioners replied 
and 5- Hospital Staff, making a total of 127, and 2 forms 
were rejected. 



The third programme - 10/ General Practitioners replied, 
and 28 Hospital Staff, giving a total of 135, 3 forms being 
rejected. 



The graphs, therefore, are relatively comparable and 
indicate a total with a differential of only nine in the 
second programme and three in the third programme. If it 
can be assumed that the nine G.P.’s who failed to reply in 
the second programme had, in fact, replied in accordance 
with the 95 who had responded, I think little difference 
would be noted. 



COMMENTS 

(l) It is clear, and indeed in the third questionnaire 
it is maintained, that the distribution and answering of 
forms of this nature is in no way rejected by doctors. 



(2) The sensitivity of the semantic differential 
method of testing seemed to provide the most valuable 
assessment of subjective response so far obtained for 
these programmes. Various methods of scoring are available 
and it may be reasonable to test a different method of 
scoring in the future. Very few doctors answering the 
questionnaire apparently had much difficulty, however, 
in using the present system. 



(3) The use of multiple choice questions for testing 
factual gain in knowledge is well established. In the test 
form for Programme 1, the multiple choice questionnaire 
worked reasonably well, and it might be open to local areas 
to re— test at some time in the future and compare the results. 
In the second programme, however, the multiple choice system 
was badly thought out and unfortunately produced virtually 
useless results. It was therefore abandoned in the third 
programme in favour of factual questions (regarding the 
three programmes) and the response of the viewing doctors 
to those questions, and to the fact of being questioned. 

This information proved extremely valuable. 



b ont . . • 



One matter is worthy of comment which was discovered 
during this pilot trial; very few doctors seem to have 
difficulty in filling in the semantic differential section, 
but considerably larger numbers failed to reply to the 
multiple choice questions. For the first programme only 
72 G.P.’s answered the multiple choice questions as 
against 104 the semantic differential. In the second 
programme only 84 replies on the multiple choice, against 
95 for the semantic. 



CONCLUSION : It is suggested that the semantic 

differential method of assessment should be extended 
and used regularly for obtaining information on subjective 
responses of doctors viewing in groups. 



It is also suggested that a small trial should be 
undertaken asking doctors viewing under individual 
circumstances at home to fill in similar forms, 
returning them as a test of subjective response under 
these different conditions. 
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FIRST PROGRAMME. 

D 

a) Copy of questionnaire sent. 
Q b) Analysis of response. 

0 
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0 
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A 



ASSOCIATION FOR THE STUDY OF MEDICAL EDUCATION 



Please circle whether G.P., Consultant, Hospital Staff, Public Health. 



IN PART A please place a cross in the appropriate square to record the 
degree to which the words at either extreme express your 
feelings about the programme. 



INTERESTING 


5 


4 


3 


2 


1 


2 


3 


4 


5 


DULL 


INFORMATIVE 


5 


4 


3 


2 


1 


2 


3 


4 


5 


UNINFORMATIVE 


CONTROVERSIAL 


5 


4 


3 


2 


1 


2 


3 


4 


5 


FACTUAL 


COMPLICATED 


5 


4 


3 


2 


1 


2 


3 


4 


5 


SIMPLE 


USEFUL TO YOU 


5 


4 


3 


2 


1 


2 


3 


4 


5 


USELESS TO YOU 



IN PART B please answer the questions in turn, indicating in the appropriate 
square the answer you believe to be correct as a result of 
watching the programme . 



1 . 



2 . 



Do the bronchi of an asthmatic 



constrict more readily 
constrict less readily 
dilate mors readily 
dilate less readily 



□ 

□ 

□ 

□ 



In severe asthma is the fixed 



component due to 
bronchial constriction 
mucosal swelling 
fibrosis 



□ 

□ 

□ 



3. 



Can respiratory tests distinguish between simple bronchitis and 

bronchitis with bronchiectasis? ,, _ 

Yes □ 



No □ 



4. Has this programme (l) altered your view of asthma 

Yes □ 

No □ 

(2) influenced you to seek more information 

Yes □ 

No □ 



B 
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0 

□ 

D 

0 

0 

0 

0 

0 

□ 

0 

0 

0 

0 

D 

D 

0 



FIRST PROGRAMME 



Rating 1-3 s- 


1 


2 


3 


4 


3 


Interesting 


22 


20 


33 


12 


5 


Dull 


1 


3 


3 


4 


1 


Informative 


26 


26 


33 


15 


• 1 


Uninf orma t ive 


0 


1 


3 


1 


0 


Controversial 


10 


11 


13 


16 


14 


Factual 


7 


10 


15 


3 


6 


Complicated 


11 


11 


15 


18 


16 


Simple 


3 


8 


9 


7 


7 


Useful 


12 


17 


33 


21 


5 


Useless 


3 


2 


5 


1 


5 



104 replies from G.P. *s 
38 replies from Hospital Staff 

142 replies out of a total of 270 sent out 
4 replies were useless 



G.P.'s of 

Q.l. 

2. 

3. 

4«i. 

ii. 



72 replies 
32 Correct 
63 Correct 
39 Correct 
19 Correct 
60 Correct 



analysed: 

44 $ 

88 $ 

46 $ 

22 $ 

87$ 



Hospital Staff : 26 replies analysed 

Q.l. 10 Correct 3 6$ 

2. 19 Correct 71$ 

3. 11 Correct 37$ 

4.i. 8 Correct 33$ 

ii. 19 Correct 71$ 
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SECOND PROGRAMME. 



a) Copy of questionnaire sent. 

b) Analysis of response. 
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ASSOCIATION FOR THE STUDY OF MEDICAL EDUCATION 



Please circle whether G.P., Consultant, Hospital Staff, Public Health. 



IN PART A please place a cross in the appropriate 3quare to record the 
degree to which the words at either extreme express your 
feelings about the programme. 



INTERESTING 


5 


4 


3 


2 


1 


2 


3 


4 


5 


DULL 


INFORMATIVE 


5 


4 


3 


2 


1 


2 


3 


4 


5 


UNINFORMATIVE 


CONTROVERSIAL 


5 


4 


3 


2 


1 


2 


3 


4 


5 


FACTUAL 


COMPLICATED 


5 


4 


3 


2 


1 


2 


3 


4 


5 


SIMPLE 


USEFUL TO YOU 


5 


4 


3 


2 


1 


2 


3 


4 


5 


USELESS TO YOU 



IN PART B please answer the questions in turn, indicating in the appropriate 
square the answer you believe to be correct as a result of 
watching the programme . 



1 . 



Do all asthmatic children have 

underlying emotional tensions 
excessive lability of the bronchus 



□ 

□ 



2 . 



Are the more severe forms of asthma more likely to 

organic basis 
psychogenic basis 



have an 

□ 

□ 



3. 



Are the milder forms of asthma more likely to have an 

organic basis 
psychogenic basis 



□ 

□ 



4. In successfully treated asthma does the physiological lability 



improve 


□ 


remain unchanged 


□ 


deteriorate 


□ 
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SECOND PROGRAMME 



Rating 1-5 s- 


1 


2 


3 


4 


5 


Interesting 


0 


10 


22 


25 


30 


Dull 


1 


1 


0 


0 


6 


Informative 


7 


15 


28 


15 


17 


Uninf ormat ive 


0 


0 


I 2 


2 


4 


Controversial 


5 


4 


27 


13 


18 


Factual 


4 


5 


9 


4 


0 


Complicated 


7 


14 


11 


6 


7 


Simple 


6 


4 


11 


8 


15 


Useful 


10 


12 


15 


15 


17 


Useless 

. 


10 


5 


3 


4 


2 
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95 replies from G.P . J s 
32 replies from Hospital Staff 
127 replies out of a total of 270 sent out 

2 replies were useless 
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G.P. 's 


of 84 replies analysed: 


Q.l. 


74 Correct 89$ 


2. 


12 Correct 15$ 


3. 


10 Correct 12$ 


4 


34 Correct 45$ 



Hospital Staff 32 replies analysed 

Q.l. 11 Correct 

2 . 4 Correct 

3* 6 Correct 

4 • 4 Correct 




THIRD PROGRAMME 



a) Copy of questionnaire sent 

b) Analysis of response. 



A 



ASSOCIATION FOR THE STUDY OF MEDICAL EDUCATION 



Please circle whether G.P., Consultant, Hospital Staff, Public Health. 



IN PART A please place cross in the appropriate square to record the 
degree to which the words at either extreme express your 
feelings about the programme. 



INTERESTING 


5 


4 


3 


2 


1 


2 


3 


4 


5 


DULL 


INFORMATIVE 


5 


4 


3 


2 


1 


2 


3 


4 


5 


UNINFORMATIVE 


CONTROVERSIAL 


5 


4 


3 


2 


1 


2 


3 


4 


5 


FACTUAL 


COMPLICATED 


5 


4 


3 


2 


1 


2 


3 


4 


5 


SIMPLE 


USEFUL TO YOU 


5 


4 


3 


2 


1 


2 


3 


4 


5 


USELESS TO YOU 



IN PART B please answer the questions in turn, indicating in the appropriate 
square the answer you "believe to "be correct as a result of 
watching the programme . 



1. Which of the three programmes on “WHEEZY CHILDREN" have you seen? 

i. □ 

2 - □ 

3 - □ 

2. Have any of the programmes 



a) helped you 


Yes □ 


NoO 


if so, which 


1- a 






2- □ 






3- □ 




b) confused you 


YesQ 


HoQ 


if so, which 


1- □ 






2- □ 






3- □ 





3. Will you continue to watch “MEDICINE TODAY"? YesQ] No| | 

4* Would you "be willing to continue to assist in testing these programmes 
by answering multiple choice questions during the next session? 



Yes 

No 



B 



THIRD PROGRAMME 



Rating 1-5 •*- 


1 


2 


3 


4 


5 


Interesting 


4 


16 


22 


30 


30 


Dull 


0 


0 


5 


0 


0 


Informative 


4 


16 


30 


31 


15 


Uninf ormat ive 


0 


4 


5 


0 


0 


Controversial 


9 


22 


28 


6 


7 


Factual 


9 


4 


10 


9 


2 


Complicated 


22 


5 


16 


6 


2 


Simple 


16 


8 


12 


12 


8 


Useful 


8 


16 


31 


21 


22 


Useless 


0 


2 


5 


2 


0 



107 replies from G.P. *s 
28 replies from Hospital Staff 

135 replies out of a total of 230 sent out 
3 replies were useless 

G.P. *s: of 72 replies analysed 48 Dad seen Programme 1 

43 » n « 2 

72 " " m ^ 

of 62 who said the series had helped them. • • 

28 said Programme 1 helped 

27 11 ,f 2 ,r 

57 ft ft ^ « 

of 26 who said the series confused them. • • 

12 said Programme 1 confused 

13 n 11 2 " 

22 *1 11 3 11 

71 of 72 said they would continue to watch Medicine Today 



70 of 72 agreed to answer multiple choice questions 
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PROGRAMME II. 




I 



I 

li 

n 



□ 

D 

D 

0 

0 

0 

0 

0 

0 

0 

□ 

0 

D 

D 

D 

Q 

D 



35 

30 _ 

25 _ 

20 _ 

15 - 

10 _ 

Ratings : 5 



INFORMATIVE « , > UNINFORMATIVE 




PROGRAMME I. 



5 



INFORMATIVE 

35 -j 
30 - 



UNINFORMATIVE 



25 _ 

20 _ 

15 - 

10 _ 

5 - 

Ratings: 



ulii 



5 4 3 2 1 




PROGRAMME II. 





35 



CONTROVERSIAL 4 



FACTUAL 





•: I 



i 



/ i 







o 

o 

0 

0 

0 

D 



0 

D 

0 

0 

D 

0 



30 _ 



25 _ 








D 

0 

D 

0 




PROGRAMME III 



